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Abstract. In this paper, we prove the existence of infinitely many homoclinic orbits for 
the first order Hamiltonian systems Jx — M{t)x + R'{t, x) = 0, by the minimax methods 
in critical point theory, when R{t, y) satisfies the superquadratic condition ^yw' — ^ 

\x\ 

as — > oo, uniformly in t, and need not satisfy the global Ambrosetti-Rabinowitz con- 
dition. 
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1. Introduction and main result. In this paper, we are interested in the 
existence of homoclinic solutions for the first-order Hamiltonian system 

(H) x = JH'{t,x) 

where x{t) = (p(t),g(t)) G x M^, -J = (^^j Q ^ standard symplectic 

matrix and H is of the type 

H{t, x) = ~M{t)x.x + R{t, x) 

with M(t) = ^ ^L{t) 0^^^ ^ ' ^ ^ continuous function taking values in the set of 

{N X A)— symmetric matrices and i? : M x — y M, [t, x) i — > R{t, x) is a continuous 
function, differentiable with respect to the second variable with continuous derivative 
R'{t,x) = ^{t,x). Here x.y denotes the Euchd's inner product of x,y E and |.| de- 
notes the corresponding Euclid's norm. As usual, assuming that a; = is an equilibrium 
for (7/), we say that a solution x of (H) is homoclinic to if x G C^(]R, M^^) satisfies 
X ^ and the asymptotic condition x{t) — > as \t\ — > oo. 

Establishing the existence of homoclinic orbits of Hamiltonian systems is one of the most 
important problem in the theory of Hamiltonian systems. During the two last decades, 
the existence and multiplicity of homoclinic solutions for Hamiltonian systems have been 
extensively investigated by many authors with the aid of the variational methods. For 
examples see [1-10] for the second-order systems, and [11-17] for the first-order systems. 

1 



2 



All classical known results for Hamiltonian systems (see [1-3,8,11-16]) arc obtained un- 
der the following assumption that the Hamiltonian satisfies the so-called Ambrosetti- 
Rabinowitz condition, that is, there exists a constant /i > 2 such that for alH e IR and 

X e M^^, |x| > r, 

< fiR{t,x) < R'{t,x).x. 

In very recent years, many authors devoted to the existence of homoclinic orbits for sec- 
ond order systems (see [5-7, 9,10]) under a kind of new superquadratic conditions firstly 
introduced by Fei [19] for the existence of periodic solutions. Motivated by the work of 
[20], the author gets recently in [17], without the Ambrosetti-Rabinowitz condition, the 
existence of at least one homoclinic orbit for ("H) under the following conditions: 
(Li) There exists a constant 7 < such that the smallest eigenvalue 

l(t) = inf L(t)^4 
1^1=1 

of L(t) satisfies 

l{t) 1*1'*'"''" — > 00 as \t\ — > 00; 

(L2) L e C^(M,M2^) and there is Tq > such that 2L{t) + L{t) and 2L{t) - L{t) are 
nonnegative definite for all \t\ >Tq, where L{t) — ^{t); 

R(t, X) r 1 Tn, 

[Rij 2 ^ fI — > 00, umjormly m t 

\x\ 

\R'(t, x)\ 

{R2) j— j > as \x\ — > 0, uniformly in i e M; 

{R3) there exist a > and a > 1 such that 

\R'{t,x)\ < a{\x\" + l), yt e M, Va; e M^^; 
{R4) there exist (3 > a, b > and r > such that 

R'{t, x).x - 2R{t, x)>b \xf , yteR, y \x\ > r, 

{R5) R'{t, x).x > 2R{t, x) > 0, Vt e M, Wx G M^^. 

Remark 1.1. It is easy to see that the function 

R{t,x) = \sin{t) \ \x\^ + \xfln{l + \xf), e R, Vx e 

satisfies (Ri) — {R5) and don't satisfies the Ambrosetti-Rabinowitz condition. 
The purpose of this paper is to show that the Hamiltonian system ("H) possesses infinitely 
many homoclinic orbits if R{t, x) is even in x and satisfies the above assumptions. 
Our main result reads as follows: 

Theorem 1.1. Assume (I/i), (I/2) and (Ri) — (R^) hold, and suppose, in addition. 



that R{t,-x) = R{t,x) for all {t,x) e R x M.^^ . Then (H) possesses infinitely many 
homoclinic orbits (xk) such that 
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/ [--^J^k-^k + -^M{t)xk-Xk - R{t, Xk)]dt — y +00 as k 



00. 



Remcirk 1.2. Observe that if x is a solution of ("H) then y{i) — x{—t) is a solution of 
the system 

Jyit) + M{-t)y{t) - R'i-t, y{t)) = 0. 

Moreover, —R{—t,x) satisfies (Ri), (-R4), (-R5) whenever R{t,x) satisfies respectively the 
following assumptions 

R{t,x) 



(R'l) 
(i?4) there exist 



—00 as \x\ 



\x\ 



00, uniformly in t G 



> a, b > and r > such that 

R'{t, x).x - 2R{t, x) < -b \xf , Vt G M, V |x| > r; 

R'{t,x).x < 2R{t,x) < 0, e M, Vx e K^^. 



So we have 

Theorem 1.2. Assume (Li), {L2) and (-R2); (-Rs)? (-^4)' (-^5) hold, and suppose, in 

addition, that R{t, —x) = R{t,x) for all {t,x) e M x M^^. Then ("H) possesses infinitely 
many homoclinic orbits (xk) such that 



/ 



[~Jxk-Xk + ^M{t)xk.Xk - R{t, Xk)]dt 



-00 as k 



00. 



2. Preliminary results. For a selfadjoint operator S acting in = L^(M, M^^), 

1 

let 'D{S) denotes the domain, 15*1 the absolute value, and \S\^ the square root. In the 
following, Q denotes a positive constant. If Si and S2 are two selfadjoint operators with 



V{Si) C V{S2), then V 



u e V{Si), then 



C V{\S2 



\Si\^u 



L2 



<C2 



\S2\^U 



Let Jo be the (2A^) x (2A^) matrix 



), and if moreover ||<S'iii|| < ci ||-S'2w|| for all 
for all u e V(\Si\h. 

1,2 

In 
In 



and Aq — —J^ + Jo, a selfadjoint operator acting in L^. Let VF^'^ = W^''^{ 



p2N 



be the usual Sobolev space. Clearly, < Aqu,Aqu >l'^- 



\u\ 



for all u e V{Ao), 



and T)[Ao) = W^'"^, where < .,. >l2 denotes the inner product. Note that letting 
+ I2n)K one has V(D) = W^'^ and = 1^5-2 (M, M2iV) = H^, the 



D = i-I 



Sobolev space of fractional order. Hence X>(|Ao|2) = H2 and 



(2.1) 



Hah ^ ^3 



\Aq\^U 



L2 



, ^ueV{\A^\-^). 



Suppose that L satisfies (Li) and {L2). Let A = —J-^ + M, a selfadjoint operator with 
T>{A) C L^, defined as a sum of quadratic forms. Let {E{X)/ — 00 < A < 00} denotes 
the resolution of A, and U — I — E{0) — E{—0). Then U commutes with A, \A\ and 

and A = \A\U is the polar decomposition of A (see [18]). T>{A) is a Hilbert space 
equipped with the norm 

lli^lli = ||(/ + |>l|)i^||^2, yueV{A). 

It is easy to verify 

(2.2) \\u\\w^,2 < C4 \\u\\^ , yu e V{A), 

i.e., ^^{A) is continuously embedded in W^'"^. Combining (2.1) and (2.2) yields 

(2.3) \\u\\^.<C5 {I+\A\)^u yueV{{I+\A\f2). 

Moreover V{A) is compactly embedded in L2(R,R2Ar) (^ggg [;^4]) rj.^^^ ^ . 

— > is a compact linear operator. Therefore a standard argument shows that the 
spectrum (7(A) of A consists of eigenvalues numbered by (counted in their multiplicities) 

■ ■■A_2 < A_i < < Ai < A2... 

with Ajfc — > ±00 as k — > ±00, and a corresponding system of eigenfunctions (e^) of A 
forms an orthonormal basis in L^. 

Now set E = 1^(1^1 2) = + 1^1)2). £^ is a Hilbert space under the inner product 

<U,V >o=< 1^1^ U, V >L2 + <U,V >L2 

and norm 



\u\\q —< U,U>Q - 



(7+ |A|)5m 



L2 

Let E^ = KeriA), E+ = CLE{span{ei, ...,e„}) and = {E^ © E+)^^ , where CLeS 
stands for the closure of 5" in £■ and S'^'^ the orthogonal complementary subspace of 5" 
in E. Then 

E^E- ®E^®E+ 

is an orthonormal decomposition of E. Since 'D{A) is compactly embedded in L^, is 
at most an isolated eigenvalue of A, then for the later convenience, we introduce on E 
the following inner product 

<u,v >=< \A\^ u, \A\^ V >i,2 + < >L2 
for all u^u~ + + u^, v ^ v~ + + e E~ ® E^ ® E^, and norm 

i 

\\u\\ —< U,U>'^ . 
Since 7 < 0, then < 1 and we get 

Proposition 2.1. [14] Let L satisfies (Li) and {L2). Then E is compactly embedded in 



5 



LP for all [1, cxd[, which implies that for all p G [1, C)o[, there exists a constant Ap > such 
that 

(2.1) II'J^IIlp ^ \ ) G E. 
Finally, we introduce 

(2.2) a{u,v) =< \A\^ Uu,\A\^ V 

for all u,v & E. a{u,u) is the quadratic form associated with A. Clearly, for u e V^A) 
and V & E we have 

(2.3) a{u,v) ^< Au,v >L2= {-Ju + Mu).udt. 

Jr 

Plainly, E~ , E^ and E^ are orthogonal to each other with respect to a, and moreover 

a{u, v) =< (P"*" - P~)u, V >, Vw, V e 

(2.4) a{u,u) = - ll"""!!^ , yu e E, 

where : E — > E^ are the orthogonal projectors and u — u~+nP+u'^ e £'~©£^°©£'+. 
The following critical point proposition will be used for proving the previous Theorem. 
Let E he a real Hilbert space with the norm ||.||. Suppose that E has an orthogonal 
decomposition E = E^ (B E'^ with both E-^ and E^ being infinite dimensional. Suppose 
{vn) (resp. {wn)) is an orthonormal basis for E^ (resp. E"^), and set 

= span {vi, Vn} © ^^ X"" = E^ ® {wi, w„} . 

Recall that we say / G C^{E,M.) satisfies (PS)* condition if any sequence (xn) with 
Xn G Xn for which < /(x„) < const, and fn{xn) — )■ as n — > oo possesses a 
convergent subsequence, where /„ = f/x„- We also say that / satisfies {PS)** condition 
if for each n G N, satisfies the Palais-Smale condition, i.e., any sequence (m^) C X^ 
for which {f{uk)) is bounded and f^i'^k) — ^ as A; — >■ oo possesses a convergent 
subsequence. 

Proposition 2.2. [11] Let E be as above and let / G C^(£',M) be even, satisfy {PS)* 
and {PS)**, and /(O) = 0. Suppose moreover that / satisfies, for any m G N, 
(/i) there is Rm > such that /(ti) < 0, Vi* G X"" with > P^; 
(/2) there are > 0, > with — >■ oo as m — > oo such that 

f{u) > a„„ Vm G (X"-^)^ wit/i = r^; 

(/s) / is bounded from above on bounded sets of X™. 

Then / has a positive critical value sequence {ck) satisfying Cfc — > oo as /c — > oo. 
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3. Proof of Theorem 1.1. Define a functional / in E by 

(3.1) f{u) = l;a{u,u) - / R{t,u)dt, Vxi e E. 
By (2.4), we have 

(3.2) f{u) = l-{\\u+f - \\u-f ) - [ R{t,u)dt, 

^ Jr 

for all M = M" + M° + M+ G © © E+. 

By (i?2), (-R3), for all e > there exists a constant > such that 

(3.3) \R'{t,x)\ <2e\x\ + {a + 1)0^1x1" , e R, Vx e M^^. 
Now, using the Mean Value Theorem and the inequahty and (3.3) imply 



m,x) 



R'{t, sx).xds 



(3.4) < e \x\^ + C, , Vt G M, Vx G R^^ . 

It is well known that (3.3) and (3.4) imply that the functional / is continuously differ- 
entiable in E and for all rt, ^; G £^ 

(3.5) f'{u)v= I {-Ju + M{t)u- R'{t,u)).vdt. 

Jr 

Moreover, the critical points oi f on E are exactly the homoclinic orbits of the system 

in). 

Now, let E^ = E- ® E^ and E'^ = with (w„ = e„)f and {wm = e_^)^ respec- 
tively, where (e„)°°o^ is the system of eigenfunctions of A (see section 2). Set also 
Xn = span{vi, ...,Vn} © -B^, = © {wi,...,Wm} and /„ = We will ver- 

ify that / satisfies the assumptions of Proposition 2.2. We will proceed by successive 
lemmas. 

Lemma 3.1. / satisfies (/i). 



Proof : We claim that there exists ei > such that 

(3.6) meas{{t G M/ \u{t)\ > ei ||m||}) > ei, Vm G X™ - {0} . 
Otherwise, for any positive integer k, there exists Uk G X"^ — {0} such that 

meas(|i G R/ \ukit)\ > ^ ||wfc|||) < ^ 

for all positive integer k. Replacing tifc by if necessary, we may assume that \\uk\\ = 1 
and 

(3.7) meas{\teR/\uk{t)\>y\)<'^ 



kr k 



for all positive integer k. Since is closed in if 2^ it is reflexive and then there exists 
a subsequence, denoted by (uk), such that (m^) converges weakly to some Uq in X"^. 
Hence by Proposition 2.1, we can assume, by going to a subsequence if necessary, that 
Uk — > Uq in L^, i.e. 



(3.8) / \uk — Uof dt — > as k — >■ 00. 



Thus there exist (5i > 0, ^2 > such that 

(3.9) meas{{t e M/ \xo{t)\ > 5i}) > 82. 

In fact, if not, we have 

measUt e M/ |'Uo(^)| > I) = 0, 



for all positive integer k, which implies that 



An ,, ,,9 At 



0< / \uof dt < \\uo\\]^oo l^ol^c^^ < t| ||«o||^ = t| — ^0 
Jr Jr 

as k — > 00 by Proposition 2.1. Hence Uq — 0, which contradicts that \\uo\\ — 1. 
Therefore (3.9) holds. 
Now let 

Io^{teR/\uo{t)\ >(5i}, \ teR/\uk{t)\ < ^ 



k J ' 
and 

By (3.7) and (3.9), we have for all positive integer k 

meas{Ik n /q) = meas{Io — [I^ n /q)) > meas{lQ) — meas{Ik n Iq) > S2 — j- 
Let k be large enough such that 

5i-\> and ^2 - 7 > ^^2, 
k 2 k 2 



one has 



\uk{t) - uo{t)\^ > \\uk{t)\ - \uo{t)\f > {5i - > ]sf, ytelkD h 

k 4 



which implies that 

/ \uk{t) - UQ{t)f' dt > I \uk{t) - UQ{t)f' dt>^6lmeas{IkfMo) 



for all large integer k. This is a contradiction with (3.8). Therefore (3.6) holds. 
For u^u~ + u'^ + u+ e X"", let 

^ {t e R/ \u{t)\ >ei||M||}. 
By (7?i), for d = ^ > 0, there exists ri > such that 

R{t, x)>d \x\^ , V > ri, Vt e M. 

Hence one has 

(3.10) R{t,u{t)) >d\u{t)\^ > \\uf 

for all ueX"" with > ^ and i e It follows from (R^), (3.6) and (3.10) that 



<, 1 II +l|2 

- 2 II II 



/" 1 2 1 

/ i?(t, M)(it < - — - — meas(r2„) 



(3.11) < <0, 

\ ) _ 2 II II 2 " " - ' 

for all u e X"^ with > The proof of Lemma 3.1 is complete. 
Lemma 3.2. / satisfies {j-^. 



Proof: Define 

r]m = sup ., ,, ■ 

ue(X'")-L-{o} jpjj 

Clearly, rjm > ?7m+i > 0. We claim that 

(3.12) Tjm — > as m — > oo. 

Arguing indirectly, assume rj^ — > rj > as m — > oo. Then there is a sequence 
Um e {^)m with \\um\\ — 1 and > |. For each Wk, there is mo G N such that 

Vm > mo, Wfe e X"*, and then < Um, Wk >— 0. 

Therefore < Um,Wk > — > as m — > oo and then Um weakly in E. So, by 
Proposition 2.1, — > as m — > oo, contradiction. Thus rjm — > as m — > oo. 
By (3.4) with e = 4^ c = one has, for u G (X™-"^)-*- 

^ 1 II ||2 1 11 ||2 II ||a+l ^ 1 II ||2 a+1 || ||a+l 



Let Tjn = [2(q; + l)cr;^-i] ' '^^ have 

1 1 

f{u) > [t - TTf r^Vm = «m "W^^^/i \\u\\ = 

Since a > 1, (3.12) shows that — > oo as m — > oo. (/2) follows. 



Lemma 3.3. Let 



g{u) = / R{t,u)dt, \/u e E. 
Jr 

Then g e C^(£', R) and g' is a compact map. 



Proof: By (3.3) and (3.4), g e C\E,R) and 
(3.13) g'{u)v = / R\t,u).vdt, yu,v e ^. 

Let Un ^ u weakly in E. By Proposition 2.1, one can assume that Un — > u strongly in 
i/ for p e [1, oo[. By (3.13), we have 

\W{un) - g'{u)\\ = sup / {R'{t,Un) - R'{t,u)).vdt 

\\v\\=l Jr 

By (3.3) there exists a constant Ci > such that for any r > 0, one has 



R'{t, u)).vdt 


<Ci [\Un\ - 


h \u\ H 


h Mn + \U\ \ \V\ 




J\t\>r 







\t\>r 

<Cl[\\vh2{[ {K\ + \u\ydty^ + \\v\\j^^+,{ [ i\Un\ + \u\f^'dt)^]. 
J\t\>r J\t\>r 

So by Proposition 2.1, there exists a constant C2 > such that for any v e E, \\v\\ — 1, 



{R'{t,u{xn)) - R'{t,u)).vdt 



\t\>r 



(3.14) < C2[( / (Kf + \uf)dt)-^ + ( / {\uX+' + \ur^')dty 

J\t\>r J\t\>r 



(3.15) 



'\t\>r •/|t|>r- 

We deduce from (3.14) that for any e > 0, there exists r > so large such that 

/ {R'{t,Un)-R'{t,u)).vdt < J, 

l\t\>r ^ 

for all n e N and all v e E^ ||v|| = 1. On the other hand, it is well known that since 
Un — >■ li, strongly in L^, 
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as n — > oo, where =] — r,r[. Therefore there is no G N such that 
(3.16) 



{R'{t,Un) - R'{t,u)).vdt 

\t\<r 



e 



for all integer n > uq and all v E E, \\v\\ = 1. Combining (3.15) and (3.16) yields 

h'iun) - g'{u)\\ < e, Vn > no. 

Hence g' is compact. 



Finally, let us prove the Palais-Smale conditions. 
Lemma 3.4. / satisfies (PS)* and (PS)** conditions. 



Proof: The verification procedure for (PS)* and (PS)** conditions are the same, and 
so we only check the (PS)* condition. Suppose w„ e Xn be such that 

(3.17) < f{un) < const, and fni^n) — > as n — > oo. 

We claim that («„) is bounded. If not, passing to a subsequence if necessary, we may 
assume that \\un\\ — > oo as n — > oo. By {R4), {R5), we have 

2/('"n) - f{Un).Un = / [R'{t, Un).Un - 2R{t, Un)]dt 

(3.18) >b [ \unfdt, Vn e N, 

J{tm/\u„{t)\>r} 

which implies 

(3.19) J — |- I \un\^ dt — > as n — >■ 00. 

By (-R2), {R3) there exists a constant C3 > such that 

(3.23) \R'{t,x)\ < C3{\x\ + |x|°), Vx e R^^. 

Hence by (3.20) 

fn{'^n)-ul = \\\Unf - I R' [t , U^) .U+ dt 
^ \ ll^nir ~ / l^'(^'«n)| \ul\ dt 
(3.21) > ^ - C3 / l-Unl" Cii - C3 / l^nl dt. 

^ Jr Jr 
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By Holder's inequality and Proposition 2.1, we have 

7m J {teK/\xn{t)\<r} 

+ / \un\'"\u^\dt<r'^ / \un\dt 

J {teR/\u„{t)\>r} J {t&B./\u„it)\<r} 

+ (/ {\uX)^dt)fdt){ f \u+\^dt)^ 

i{t eM/ 1 (t) I >r } J {teM./\u„it)\>r} 

< r° + ( / |Mn|^dt)t IKII ^ 

J {teM./\Mt)\>r} ^ 

(3.22) <[Air" + A^(/ . 

J {tm/\un{t)\>r} 

Similarly, 

Jm. i{t6M/|w„(t)|<r} i{t6M/|w„(t)|>r-} 

J{teIR/|u„(t)|>r-} 

(3.23) <[Xir + X0'{[ \unfdt)l^]\\u^\\, 

where P' is the Holder's conjugate of /3. Combining (3.21), (3.22), and (3.23), yields 

/V)-«n >^lhnir-AiC3r + r]||a;+|| 

-C3[A^(/ \Unfdt)f 
J {teR/\un{t)\>r} 

(3.24) +A^,(/ \un\''dt)^]\\u^\\. 

J {teR/\un{t)\>r} 

Since 1 < a < /3, we deduce from (3.19) and (3.24) that 

(3.25) ^Oasn^oo. 
Similarly, 

(3.26) ^ as n ^ oo. 
Now, let 

97^ „ u\ _ / «n(t), if \un{t)\ < r, 

^'^■^^^ M*)-| 0, if Mt)\>r, 
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and 

for all integer n and all t e R. By (3.18) and (3.27), there exists a constant C4 > such 
that 

(3.18) C4(l + \\un\\) > , Vn e N. 

Since is of finite dimension, we deduce from Holder's inequality and (3.28) 

K\\l2 =< ul,Un >L2=< ul,Vn >i,2 + < >i2 

(3.29) < r IKII^i + IKII^^, IknlL^ < C5 (1 + WWnWLp) 

for all integer n and some constant C5 > 0. Hence by (3.28) and (3.29), there exist 
positive constants Cq, C7 such that for all integer n 

(3.30) < C6 ||tin||i,2 < C5C6(1 + H^^nlli/j) < 07(1 + \\UnP). 

Since /3 > 1, we deduce from (3.30) that 

(3.31) ^ as n ^ oo. 
Combining (3.25), (3.26) and (3.31) yields 

(3.32) 1 = 1^ < ll^nll + jj^°|j + ll^nll ^ as n ^ OO, 

which is a contradiction. Hence («„) must be bounded. By Lemma 3.3, we deduce that 
(un) possesses a convergent subsequence, which completes the proof of Lemma 3.4. 

■ 

The functional / satisfies all the assumptions of Proposition 2.2, so it possesses a 
positive critical value sequence (c^) satisfying cjt — > oo as A; — > oo. Therefore the 
system (T-L) possesses infinitely many homoclinic orbits Uk satisfying f{uk) — > oo as 
k — > oo. 
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